Dynamics on Modular Networks with Heterogeneous Correlations 
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We develop a new ensemble of modular random graphs in which degree-degree correlations can 
be different in each module. We present an analytical approach that allows one to analyze several 
types of binary dynamics operating on such networks, and we illustrate our approach using bond 
percolation, site percolation, and the Watts threshold model. The new network ensemble general- 
izes existing models by allowing a heterogeneous distribution of degree-degree correlations across 
modules, which is important for the consideration of nonidentical interacting networks. 



I. INTRODUCTION 

It can be very useful to view a network as consisting 
of a set of heterogeneous, interconnected modules P, 
The connections between nodes in the same module or 
between nodes from different modules tend not to be 
uniformly random. For example, they might depend on 
nodes' degrees (or other structural characteristics) or on 
their module assignments. Furthermore, the meaning of 
network modules depends significantly on context. For 
example, a module in a social network might represent 
a group to which an individual belongs, while a parti- 
tion of a technological network into modules might yield 
subnetworks that each contain different types of nodes. 

Amidst the escalating data deluge, networks con- 
structed from multiple interconnected parts or which 
contain multiple types of nodes have attracted consid- 
erable recent interest Such networks, for exam- 
ple, can be used to study the failures on interdependent 
power grids [&], the spread of social influence through 
multiple media, or transportation via multiple modes of 
travel 18| . It is therefore important to develop new ran- 
dom graph models for studying such processes. For ex- 
ample, in order to detect cohesive groups of nodes (i.e., 
communities) algorithmically in such networks, one needs 
to develop and analyze more sophisticated random-graph 
null models against which to compare the structure of 
real networks Q. 

In the present paper, we develop a model of networks 
consisting of interconnected modules, where each module 
is defined by its own joint degree-degree distribution, and 
the connections between nodes from different modules are 
defined by a joint degree-degree distribution of nodes for 
each pair of modules. One can think of each module as 
a separate network, so the aggregate network under con- 
sideration constitutes a "multiplex" network. (Indeed, 
multi-module networks have many names in the litera- 
ture, including "interdependent networks" , "coupled net- 
works", and more |3l-[l7|.) 

The model that we introduce in this paper is a gener- 



alization of several random-graph models. One of them 
is the well-known configuration model [Toj . in which a 
degree distribution pk is specified but connections be- 
tween stubs (i.e., half-edges) are assigned uniformly at 
random. Another model, which we call the Pk.k' network 
model, describes single-module networks and is defined 
by a joint degree-degree distribution (i.e., via degree as- 
sortativity) [13] ■ A third model, which we call the i?*'* 
network model, generates multi-module networks that 
have no a priori degree-degree correlations [2l| . 



We develop an analytical method that can be used to 
investigate a broad class of binary-state dynamics oper- 
ating on networks produced by our network model. We 
show that our network model successfully captures fea- 
tures of network topology that Pk,k' and i?*'* networks 
are unable to capture, and that the analytical method 
successfully captures a broader class of dynamic behav- 
iors than observed in Pk^k' networks. We use numeri- 
cal simulations to test the accuracy of our analytical ap- 
proach using several synthetic and real-world networks. 
We also discuss example networks that further justify the 
new random-graph ensemble. 



The remainder of this paper is organized as follows. 
In Sec. ini we introduce our new random-graph ensemble 
(which we call the Pl'\, network model). In Sec. IIIIl we 
present our analytical approach to solving binary-state 
dynamics on such networks. In Sec. IIVI we show that 
both Pk^k' and i?''* networks and binary-state dynamics 

thereon are special cases of Pi']., networks. In Sec. |Vl 
we examine several examples of dynamical processes and 
compare the predictions of our theory with numerical 
simulations. In Sec. IVI[ we use both synthetic and real- 
world networks to provide examples with more compli- 
cated topologies. Finally, we present our conclusions in 
SecEni 
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II. 



Pl'l, NETWORKS 



Consider an undirected, unweighted connected net- 
work consisting of N nodes that are distributed across 
Up modules such that each node is a member of exactly 
one module and k^^^^ is the maximum node degree in 
module i. (We define the node degree to be the total 
number of a node's neighbors across all modules. It can, 
of course, also be desirable to be more nuanced and con- 
sider multiple types of degree ■S'l.) We define Pl'\, to 
be the probability that a randomly chosen edge connects 
a degree-A; node from module j to a degree-fc' node from 
module i' [i^. As we illustrate in Fig.[Tl one can think of 
the tensor Pl'\, as an Up-hy-Up block matrix. Each block 
is a fcmax"by-Amax matrix of scalars, so Pl'\, con- 
sists of a total of {J27=i ^max) ^ scalars. Each block on the 
main diagonal is given (up to a proper normalization) by 
the joint degree-degree distribution for that module, and 
off-diagonal blocks represent connections between pairs 
of different modules. 

Module i 
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FIG. 1: Schematic of a matrix representing the joint degree- 
degree, module-module distribution -P^'^/ for a network that 

consists of Up non-overlapping modules, where fej^^x is the 
maximum degree for nodes in module i. The matrix is com- 
posed of np-hy-Up blocks. The i-th block on the diagonal 
is given (up to a proper normalization) by the joint degree- 
degree distribution for module i. The off-diagonal blocks char- 
acterize connections between pairs of modules. The number 
of elements in each block is given by the product fc^^x x ^max 
of maximum degrees for nodes from the corresponding mod- 
ules. The total number of scalars in the (symmetric) matrix 

To construct an A'^-node network drawn from the en- 
semble of random graphs with specified Pl'\, distribu- 
tion, we first need to calculate how many edges of each 
type will be in the network. We therefore calculate the 
degree distribution 



Pk 




E 



pi, I 

k 



(1) 



,k' j I ,k,k' 

and we note that the mean degree is z = kpk- 



Therefore, the number of edges of type {(i, fc),(i', fc')} 
(i.e., edges that connect a degree-fc node from mod- 
ule i to a degree-fc' node from module i') is given by 



^zNPl'\.,. We then create the required number 



of edges of each type and put degree-fc nodes in module 
i by collecting fc edge ends of type («, fc) uniformly at 
random. When we have collected all edge ends into such 
bunches, we have obtain the desired network. 

Importantly, a Pl'\., network can be obtained from a 
real-world network (or any other empirical network) by 
rewiring its edges using an algorithm that preserves the 
Pi']., distribution but otherwise randomizes connections 
between the nodes [4711. 



III. ANALYTICAL CALCULATION OF 
DYNAMICS ON pI'^^ NETWORKS 

In this section, we consider binary-state dynamics on 
networks — in which nodes can be in one of two possible 
states, which we call "inactive" (0) and "active" (1) — and 
present analytical expressions for calculating the fraction 
of active nodes in a network starting with some (possi- 
bly 0) fraction of initially active nodes. We consider a 
broad class of dynamics that can be described in terms 
of response functions Fi(m,k), which describe local in- 
teractions among neighboring nodes and which can be 
defined independently for each module i. The response 
function Fi{m,k) gives the probability that a degree-fc 
node in module i becomes active when it has m active 
neighbors. 

The analytical method that we employ is based on pair- 
wise interactions between nodes (211, , and it requires 
that the response functions Fi{m,k) be non-decreasing 
functions of ni for any fixed fc. This condition reflects 
the effect of positive externalities: a node is more likely 
to become active when it has more active neighbors. Ex- 
amples of dynamics that satisfy this requirement include 
bond percolation, site percolation, the Watts threshold 
model, and the calculation of fc-core sizes [2l|. In Sec.lVl 
we will discuss the first three of these examples. 

To calculate the fraction of active nodes at discrete 
time n, we employ the approach introduced in Refs. 12 ll . 
[22j , and which has proven to be very fruitful [23l - l30j |. 
We define q\{n) to be the probability that a degree-fc 
node in module i is active at time step n, given that at 
least one of its neighbors is inactive. The probability that 
a neighbor of an inactive degree-fc node in module i (at 
time step n) is active is then given by the expression 

-i , ■, J2i'J2k'-^k,k'1k'(''^) 

ql in) = „ ^ , (2) 

l^i' l^k' ^k,k' 

because a degree-fc node of module i has a neighbor of 
degree fc' node in module i' with probability 



fc.fc' 



EY^ pi, I' 
i' l^k' ^k,k' 
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Therefore, starting with the initial condition ql{0) = 
pI.{0), where p\{0) is the initially active fraction of 
degree-fc nodes in module i, one can compute the val- 
ues of q\{n) using the recurrence equation 



gI.(n + l)=pUO) + (l-pUO)) 
fe-i 



(3) 



Equation ([3]) describes a situation in which a node that 
was initially inactive becomes active when it has a suf- 
ficient number of active neighbors (given that one of its 
neighbors is inactive). 

The probability that a degree-fc node in module i is 
active at time step n (i.e., the fraction of active degree-fc 
nodes in module i) is given by 



pU") = pUo) + (1 - pUo)) 



(4) 



m=0 



From dH), one calculates that the fraction of active nodes 
in module i is 



(5) 



with p\ the degree distribution for nodes in module i 



Pk 





pi,i 


'^-ji' .k' 


k,k' 
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(6) 



and the aggregate active fraction of nodes in the entire 
network is 



(7) 



where 




pi, I 

^k.k' 



(8) 



is the number of nodes in module i. 
IV. REDUCTION TO P,- k' AND MODELS 



Our Pl:\, random-graph ensemble generalizes two well- 
known models: Pk,k' networks, which consist of a single 
module defined by a joint degree-degree distribution of 
nodes Pk,k' [13, El) and the uncorrelated multi-module 
network ensemble (so-called networks), which are 
defined by the degree distribution p\. of each module and 



the probability that a given network edge connects 
a node from module « to a node from module i' [3l] | . The 
quantities defining these networks can be calculated from 



the Pl^\, distribution as 



Pk,k' = E ^' 



,1.1 



i.i' 



and p], as in Eq. ([6|) . 

Equations ©-(H]) apply to both P^^k' networks and 
networks. Consequently, one can derive results for 
Pk,k' , -E''* , and P^\, networks by using only the imple- 
mentation for Pl:\, networks. For example, to obtain the 
results for E'-'^ networks using Eqs. ([2])-(|4]), one needs to 
input the corresponding uncorrelated P^.']./ matrix that is 

constructed from a given mixing matrix i?*'* and degree 
distribution of nodes in module i using 



■ PkPk' 



Efe kpl Efc' k'pt, 



(10) 



To obtain results for Pk,k' networks, one can directly 
use the joint degree-degree distribution matrix Pk,k' in 

Eqs. (I2])^(|ll) because it represents a single-module Pl'\, 
network. When considering example networks, we use 
this technique to compare the results given by Eqs. ([2])- 

(jlj for Pl'\,, Pk.k' , and i?*'' networks (and we refer to 
these results as correspondingly P^,'^,, , Pk,k', and 
theories) . 



V. EXAMPLES OF DYNAMICS ON MODULAR 
SYNTHETIC E'-'' NETWORKS 

In this section, we consider several examples of dynam- 
ical processes on modular networks. We compare compu- 
tational results to theoretical predictions from Eqs. 
(|4]). We use i?*'* networks, which we showed in Sec. IIVI 

are a special case of Pj:]., networks. We consider exam- 
ples with more complicated specifications in Sec. IVIl 

In E^'^ networks, each node is a member of exactly one 
of the Hp modules. The nodes draw their degrees k from 
the degree distribution p^, which is specified separately 
for each module i. Each edge from a node belonging to 
module i is connected to a node from module j with a 
fixed probability. These probabilities can be described 
conveniently by an rip-hy-rip mixing matrix E^'^ , whose 
representative element gives the probability that a 
randomly chosen edge in the network connects a node 
from module i to a node from module j. There are A^, 
nodes in module i and the network is otherwise random. 

In the examples below, we use an i?*'* network that 
we designed to demonstrate the advantage of P^'^, theory 
over Pk^k' theory. The network consists of two modules 
with iVi= 10000 nodes each. The first module contains 
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only nodes of degree 4. The second module contains 
nodes of degrees 4 and 12 in proportion 1:1, and the 
mixing matrix 

defines the interconnections between the modules. Such 
a network is thus an example of a (fci, fc2)-regular graph 
(i.e., a graph in which all nodes have either degree ki or 
degree fc2 [33 )■ We show a schematic representation of 
a network drawn from this ensemble in Fig. [2j In the 
following subsections, we investigate several dynamical 
processes on such networks. 

Module 1: 10000 Module 2: 5000 degree-4 

degree-4 nodes and 5000 degree-12 nodes 



Notice that different values of pi for different modules 
i imply a variant of semidirected bond percolation [l^ , 
in which one formally replaces every edge of the original 
undirected network by two directed edges running in op- 
posite directions and edges pointing to nodes of module i 
are occupied with probability . However, for simplicity 
we consider classical bond percolation, i.e., we assume 
that Pi = p for all modules i. 

Given a network adjacency matrix, we calculate the 
distributions -P^'^; and Pk,k' and then use them and the 
response function in Eqs. ©-Q to predict the GCC 
size for a particular value of p. (One can also obtain an 
analytical result for GCC sizes on Pk^k' networks using 
Eq. (12) of Ref. [s^.) We compare the predictions from 

Pl'\, and Pk,k' theories in Fig. [31 




FIG. 2: Schematic of the -B''' network described in the text. 
Module 1 consists only of degree-4 nodes, and module 2 con- 
sists of nodes of degrees 4 and 12 in proportion 1:1. (The 
darker nodes have degree 12.) 
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A. Bond Percolation 

We begin by considering bond percolation, which has 
been studied extensively on networks [l9l |. In bond per- 
colation, network edges are deleted (or labeled as "un- 
occupied" ) with probability 1 — p, where p is called the 
bond occupation probability. One can measure the effect 
of such deletions on the aggregate graph connectivity in 
the limit of infinitely many nodes using the fractional 
size of the giant connected component (GCC) at a given 
value of p. (In this paper, we use the terminology GCC 
for finite graphs as well; one can alternatively use the 
term "largest connected component" for finite graphs.) 
Bond percolation has been used in simple models for bi- 
ological epidemics [19|, |33|, [sj]. In such a context, p is 
related to the mean transmissibility of a disease, so the 
GCC is used to represent the size of an epidemic out- 
break (and to give the steady-state infected fraction in a 
susceptible-infected- recovered model) . 

To apply Eqs. ©-([l]) to bond percolation, observe that 
network edges are occupied with probability p and that 
nodes become infected (i.e., active) if they are connected 
to an infected node by an occupied edge. Therefore, a 
node with m active neighbors has probability (1 —p)™ of 
not becoming infected, so the response function is 

F,{m,k)^l-{l-p,r . (12) 



FIG. 3: GCC size versus bond occupation probability for 
networks consisting of two modules of size 7Vi = 10000 nodes 
each. The first module contains only degree-4 nodes. The 
second module consists of nodes of degrees 4 and 12 in pro- 
portion 1:1 (see Fig. [5]). The mixing matrix is given by 
Eq. The result from -P^'^/ theory is indistinguishable 

from numerical simulations, whereas the Pk,k' theory clearly 
fails to describe the observed result. For our numerical com- 
putations, we averaged over 1000 realizations. 

We performed numerical calculations of the GCC size 
by applying the algorithm of Ref. [s^ to the network's 
adjacency matrix and plotted the average results as black 
disks in Fig. [3] It is apparent from Fig.|3]that Pl^\, theory 
outperforms Pk,k' theory on this example. 

The peculiar shape of the numerical curve in Fig. [3] 
can be understood by recalling that the bond percolation 
threshold (i.e., the value of p at which the GCC appears 
as p increases) for random networks where all nodes have 
degree k is given by pth = 1/(^ — 1) [3- In Fig. |31 the 
percolation threshold is dominated by degree-12 nodes of 
module 2, but its value is shifted to the right from 1/11 
because of the presence of degree-4 nodes in the same 
module. The step that appears aX p ~ 1/3 is due to 
percolation of module 1, which consists entirely of degree- 
4 nodes. More generally, this also illustrates that (/ci, fe)- 
regular graphs can be very useful for probing the behavior 
of dynamics on networks [33|. 
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B. Site Percolation 

We now consider site percolation, in which we remove 
nodes (along with the edges connected to those nodes) 
instead of removing edges [l9| . This, for example, can 
be used as a toy model of the vaccination of individuals 
against a disease. In the context of a disease spreading 
through the network of contacts, vaccinated individuals 
do not contribute to the spread of the disease and can 
be considered as having been removed from a network. 
In this case, the GCC again represents the size of an 
epidemic outbreak. 

To model the site-percolation process, nodes are occu- 
pied with a selected probability and occupied nodes be- 
come active (i.e., infected) if they have one or more active 
neighbors. Unoccupied nodes can never become active. 
The response function for site percolation is therefore 

^^(™'^) = {Q{,otheTwrse ' ^''^ 

where Qj. is the occupation probability of degree-fc nodes 
in module i. 




FIG. 4: Site percolation on the same -E*'' network as in Fig. [S] 
We plot the size of the GCC versus the occupation probabil- 
ity of degree- 12 nodes. For our numerical computations, we 
averaged over 100 realizations. 

In the example in Fig. 21 we compare numerically cal- 
culated GCC sizes for the site-percolation process with 
those obtained using Pl'\, and Pk,k' theories. We con- 
sider the same two-module network as in Fig. [3] Re- 
call that the first module contains only degree-4 nodes, 
whereas the second module is a mixture of degree-4 and 
degree-12 nodes. For simplicity and in order to be able to 
compare results from Pl'\i and Pk,k' theories directly, we 
fix all Q\ — 1 and calculate the GCC size as we vary Q12, 
the occupation probability of degree-12 nodes in module 
2. (In other words, we have constructed this example so 
that degree-12 nodes are occupied with probability Q12 
and all other network nodes are occupied with probabil- 
ity 1.) The results of direct numerical computation are 
approximated very well by the results of Pi']., theory but 
not by those of P/c./c' theory. 



C. Watts Threshold Model 

About a decade ago, Watts introduced a simple model 
for the spread of cultural fads |:37] . It allows one to exam- 
ine how a small initial fraction of early adopters can lead 
to a global cascade of adoption via a social network and 
it distinguishes between "simple" and "complex" conta- 
gions [3^ [s^. In the Watts model, each node of a net- 
work is randomly assigned a fixed threshold R from a 
specified distribution. A degree-fc node becomes active if 
its fraction m/fc of active neighbors exceeds R. Cascades 
of activations can be initiated by randomly activating a 
seed fraction p{0) of the nodes or, in a more general set- 
ting, by randomly activating a fraction Pfc(O) of degree-fc 
nodes in module i. The response function for the Watts 
threshold model is 

F,(m,fc) = Q(m/fc), (14) 

where Ci is the cumulative distribution function of nodes' 
thresholds in module i. If, for example, all nodes in mod- 
ule i have the same threshold Ri , then the response func- 
tion becomes 

, J. / 0, if m/fc < i?j , . 

= I 1, otherwise ' ^^^^ 
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FIG. 5: Watts threshold model on the same i?*'' network as 
in Fig. [3l We plot the final fraction of active nodes versus the 
threshold R, which is identical for all nodes. Initially, 0.1% of 
the nodes (chosen uniformly at random) are active. For our 
numerical computations, we averaged over 10 realizations. 

In Fig. [Sj we show the final fraction of active nodes for 
the Watts threshold model versus the threshold R, which 
for simplicity we take to be the same for all nodes in the 
network. In this figure, we use the same E^'^ network 
as for Figs. |3] and m Initially, we activate 0.1% of nodes, 
which we chose uniformly at random. (In particular, note 
that we did not differentiate the modules based on how 
we chose the initially active seeds.) Nodes subsequently 
become active according to Eq. ([T5|) . The results of direct 

numerical simulations are captured accurately by Pl']^, 
theory but not by Pk^k' theory j21j, highlighting the fact 
that modular structure is important for this process. 

In Fig. [SI the P^']^, theory curve exhibits sharp tran- 
sitions at i? = 1/4 and R = 1/6. The first jump at 
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i? = 1/4 is due to degree-4 nodes in module 1 becoming 
active when they have at least one active neighbor, so all 
nodes in module 1 are active at the end of the process. 
However, module 2 has not experienced an activation cas- 
cade at this R because most edges in it connect a pair of 
degree-12 nodes, which collectively remain inactive. The 
jump at i? = 1/6 occurs when degree-12 nodes become 
active as a result of having only 2 active neighbors. In 
this situation, both modules eventually experience acti- 
vation cascades. There is, however, only one jump in the 
Pfc_fc/ theory curve, at R = 1/4; this occurs when having 
a single active neighbor is sufficient to activate a degree-4 
node. The curve has the given shape because Pk,k' the- 
ory mixes all degree-4 and degree-12 nodes in a single 
module. Therefore, degree-12 nodes are surrounded by 
many more (active) degree-4 nodes than in module 2 in 
the actual network. This leads to an erroneous prediction 
of an activation cascade among degree-12 nodes. 



VI. ADVANCED EXAMPLES 



A. Synthetic Pl'l., Networks 



The examples that we illustrated in Figs. [21 HI and [S] 

can be captured using i?*'* theory, because the synthetic 
network that we used in those figures is an i?*'* network. 

To demonstrate the full advantage of the Pl'\, network 
model and theory, we generate synthetic Pl'\, networks 

that cannot be constructed using the simpler i?*'* net- 
work model and investigate dynamical systems on such 
networks. As an example, we consider an ensemble of 
graphs generated according to the following P^'^, ma- 
trix [H: 

i = 1 



3 nodes from module 2 connect exclusively to degree- 11 
nodes. 




i 


= 2 






= 3 


fc = 11 











fc' 


= 3 i' = 1 







fc' 












9 




fc' 


= 11 








(16) 



^k,k' ^ •- 



Networks defined by the Pf.'/./ matrix (fT6)) consist of two 
modules. The first module (z = 1) contains only nodes 
of degree fc = 3, and the second module (i = 2) contains 
nodes of degrees fc = 3 and fc = 11 (see the schematic 
in Fig. [5]). From the first row of p^ . we see that, on 
average, degree-3 nodes from module 1 have 20 connec- 
tions to nodes of the same type (i.e., to degree-3 nodes in 
module 1) for every 1 edge to degree- 11 nodes of module 
2. Similarly, from row 3, we see that, on average, the 
degree- 11 nodes (which only appear in module 2) have 1 
edge to nodes of the same type and 1 edge to degree-3 
nodes from module 1 for every 9 edges to degree-3 nodes 
from module 2. Finally, row 2 indicates that all degree- 



Module i = 1: 
degree-3 nodes only 



Module i = 2: degree-3 
and degree- 11 nodes 




FIG. 6: Schematic of a Pl'],i network with the PI']., ma- 
trix (|16p . Module 1 contains only degree-3 nodes, and module 
2 contains nodes of degree 11 (darker color) and of degree 3. 



The ensemble of Pl'\, 



networks with Pl'\., 



matrix (|16|) 

cannot be accurately described either by Pk,k' or by i?'^* 
network models. We will now demonstrate using two ex- 
amples that Pj.']., theory is required to accurately model 
dynamics on such networks. 

In Fig. [71 we show bond percolation results for an en- 
semble of 25000-node P^'J,/ networks defined by the P^'\, 

matrix ^ (cf. Fig.[3l). We calculate the E''' and Pk,k' 
distributions from using Eqs. (O, and plot in Fig. [3 
the GCC sizes calculated for each value of p using i?*'' , 
Pk,k' and Pl'\, theories. As seen in the figure, only P^']., 
theory produces good agreement with the numerical sim- 
ulations for all values of the bond occupation probabil- 
ity. In particular, observe the differences in the predicted 
values of the percolation threshold Pc- Interestingly, i?*'* 
theory predicts a value of Pc that is too low, whereas Pk,k' 
theory predicts a value that is too high. 




• Nmiierics 

Pk.k' theory 

E^'^ theory 



FIG. 7: GCC size versus bond occupation probability for 
25000-node PI']./ networks that consist of two modules gen- 



erated according to the Pl'\., matrix (|16|l . The first module 
consists only of nodes of degree 3, and the second module 
consists of nodes of degrees 3 and 11. The result from P^'],, 
theory is indistinguishable from direct numerical simulations 
(averaged over 1000 realizations), whereas P^^k' and -E''* the- 
ories fail to accurately describe the observed behavior. 
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We use networks with the same Pi']., matrix (jl6p in 
Fig. [8] (but with a larger number of nodes) to demonstrate 
the temporal evolution of the fraction of active nodes de- 
termined by the Watts threshold model. Initially, we 
activate 0.1% of nodes, which we chose uniformly at ran- 
dom from module 2. (To calculate the Pk,k' theory curve 
we set Pfc(O) = T^-PkPkW^ which represents the initial 
activation of the same number nodes of each degree as in 
the simulated case, but chosen uniformly at random from 
the entire network.) Nodes subsequently become active 
by interacting with their neighbors as specified by the re- 
sponse function (fT5|). In this example, all nodes have the 
same threshold R = 0.18. To obtain continuous-looking 
numerical results, we use asynchronous updating and up- 
date a single node (chosen uniformly at random) at each 
time step of size At = 1/7V. The theoretical curves also 
show dynamics in continuous time [we explain in the Ap- 
pendix how these can be obtained from the discrete-time 
Eqs. ©-(HI)]. Again, Pl'\, theory outperforms both Pk^k' 
and E'*'* theories. 




5 6 7 8 9 10 11 12 13 14 15 

t 



FIG. 8: Temporal evolution of fraction of active nodes in the 
Watts threshold model on P,''!, networks with A*' = 5 x 10^ 

nodes distributed across two modules according to the PI']., 
matrix l|16p . The first module consists only of nodes of de- 
gree 3, and the second module consists of nodes of degrees 3 
and 11. The result of Pi']., theory agrees better with direct 

numerical simulation than do the results of Pk,k' and 
theories, which fail to describe the observed results. Initially, 
we activate 0.1% of nodes chosen uniformly at random from 
module 2. For Pk^k' theory we use seed fraction that rep- 
resents the equivalent number of nodes of each degree, but 
chosen (uniformly at random) from the entire network. For 
our numerical computations, we averaged over 10 realizations. 
At each time step of size At — 1/N, we updated a single node, 
which we chose uniformly at random. 



B. Conjoined Real- World Networks 

Thus far, we have considered synthetic networks gen- 
erated using the Pl'l, model (and special cases thereof). 

It is also important to examine the applicability of Pi']., 
theory to real- world networks. As a hrst example, we 



take two real-world networks and join them into a sin- 
gle network by adding random edges between them such 
that the original networks can be considered as modules 
in the resulting network. 

In Fig. ini we examine bond percolation properties of 
a network obtained by joining a Facebook network of 
Caltech [4^ |4l| to a network of interacting proteins 
,44] with 700 edges added between the two networks uni- 
formly at random, up to the restriction that the added 
edges lead exclusively from one network to the other . 

We then applied Pk^k' , E^'^ , and Pl'^, theories to see how 
well they capture the results of direct numerical simula- 
tions of bond percolation on the conjoined networks |5(| . 
Unlike the synthetic examples that we discussed previ- 
ously, the conjoined Caltech-protein network has degree- 
degree correlations inside of each module that appear 
naturally. The results of Fig. [3] demonstrate that Pl'l, 
theory captures the bond percolation dynamics better 
than the other theories. 
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FIG. 9: GCC size versus bond occupation probability for the 
Caltech Facebook network conjoined to a protein interaction 
network. The results of P")., theory are better than those 

of Pk,k' and theories. In this example, we have added 

700 edges uniformly at random from the first network to the 
second. The insets show the results for using many more 
(7000) or far fewer (10) joining edges. When there are 7000 
Caltech-protein edges, the resulting network becomes essen- 
tially random so all three theories are adequate. When there 
are too few joining edges, finite-size effects prevent any of the 
three theories from working well. 

In Fig. I10[ we show continuous-time evolution of the 
fraction of active nodes for the Watts threshold model 
running on multi-university Facebook networks. This 
provides a real-world example of interdependent net- 
works rather than two disparate real- world networks that 
we joined artificially. We consider the Michigan23 and 
MSU24 Facebook networks [Zlj] along with the cross- 
university edges that exist between these users (nodes). 
The largest connected component of the aggregate net- 
work has N — 62770 nodes, a mean degree of z ~ 82, a 
degree-degree correlation coefficient of r « 0.044, and a 
clustering coefficient |45| of C « 0.201. The number of 
inter-university edges is m = 290279 (i.e., about 11.2% of 
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the total number of edges). When separated, the GCCs 
of the Michigan23 and MSU24 modules of the network 
have, respectively, N — 30106 and N = 32361 nodes, 
mean degrees of z w 78 and z ~ 69, degree-degree cor- 
relation coefficients of r « 0.115 and r « 0.009, and 
clustering coefficients of C « 0.21 and C « 0.204. 
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FIG. 10: Temporal evolution of fraction of active nodes in 
the Watts threshold model on a multi-university Facebook 
network. We update nodes asynchronously, choosing a single 
node uniformly at random during each time step of size At — 
1/N. All nodes have identical threshold R — 0.1, and we 
initially activate (uniformly at random) 5% of the nodes in 
the MSU24 module. For Pk^y theory we use seed fraction that 
represents the equivalent number of nodes of each degree, but 
chosen (uniformly at random) from the entire network. We 
average the results of our numerical computations over 10 
realizations. 

As an initial condition, we select (uniformly at ran- 
dom) 5% of the nodes in the MSU24 module to be 
initially active. (For Pk.k' theory we set pk{0) = 
J2i ^PkPki^)^ which represents the initial activation of 
the same number of nodes of each degree as in the sim- 
ulated case, but selected uniformly at random from the 
entire network.) At each subsequent time step (of size 
At = 1/A^), we update a single node (chosen uniformly 
at random) according to the threshold rules ([T5|) . Like in 

all previous examples, one can see in Fig. [10] that Pl'\, 
theory outperforms Pk^k' and i?*'* theories. 

VII. CONCLUSIONS 

We have developed a random-graph ensemble to de- 
scribe multi-module networks in which modules can have 
different degree-degree correlations. We also present an 
analytical method to investigate a broad class of binary- 
state dynamics on such networks. Our network model 
generalizes the configuration model, random networks 
with degree-degree correlations (i.e., Pk,k' networks), and 
multi-module networks without correlations (i.e., i?''* 
networks), and it provides an alternative description of 
interacting networks to those that have been examined 
recently by other authors [ll| - [T^ . 

We have also demonstrated using both synthetic net- 
works and real-world networks that -P^'^/ theory can ex- 



plain dynamics that neither Pk^k' nor i?*'* models are 
able to capture. In particular, the analytical approach 
that we presented allows one to consider situations in 
which dynamics can be different on different modules. 
Our model can also be generalized to include more than 
two (degree and module) types of correlations, and we 
expect that such efforts will be important for the in- 
vestigation of dynamics on complicated interdependent 
networks. 
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Appendix: Continuous-Time Analytical 
Approximation 

In this appendix, we demonstrate how the discrete time 
Eqs. (|2])- (|4)) c an be used to approximate continuous-time 
evolution [2l|. We first rewrite Eqs. ^ and ^ in concise 
form as 

qlin+l)^gi{qi{n)) , (A.l) 
pUn + l)^hl (qlin)) , 

where (fi^{n) is obtained from Eq. These equations 
describe the case of synchronous updating, in which the 
states of all N network nodes are updated at each discrete 
time step n. It is possible to modify these equations to 
account for situations in which only the states of a cer- 
tain fraction t of nodes (chosen uniformly at random) 
are updated. Thus, the value r = 1 corresponds to syn- 
chronous updating of all nodes and r = 1 /N corresponds 
to the completely asynchronous case in which a single 
(randomly chosen) node is updated at each time step. 
For the monotone dynamical processes that we consider 
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in this paper, both types of updating lead to the same 
final state but the transient dynamics can be different. 

To deal with asynchronous updating, in which only 
a fraction r of nodes is updated at each time step, we 
use time step At = t so that we have a common time 
scale for all r (including the synchronous updating case 
of T = 1). If the updating is synchronous (i.e., if r = 1) 
as in Eqs. (jA.ip . then the probability increases by 
^9fe = 5fc ~ other words, all nodes that 

are available for activation are activated. In the asyn- 
chronous updating case, only a fraction r of all nodes 
available for activation are activated, thus increases 



by Aql = T (gj, — ql) . Therefore, for sufficiently low 
values of r, the temporal evolutions of ql and p}. can be 
approximated as continuous. This yields the following 
set of ordinary differential equations: 

^ = gliqlit)) - qlit) , (A.2) 

^-hl{qm-Plit), 

which we use to produce continuous-theory curves for the 
Watts threshold model in Figs. 151 and [TUl in the main text. 
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